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Abstract 

A new problem formulation is presented for the Gaussian interference channels (GIFC) with two 
pairs of users, which are distinguished as primary users and secondary users, respectively. The primary 
users employ a pair of encoder and decoder that were originally designed to satisfy a given error 
performance requirement under the assumption that no interference exists from other users. In the case 
when the secondary users attempt to access the same medium, we are interested in the maximum 
transmission rate (defined as accessible capacity) at which secondary users can communicate reliably 
without affecting the error performance requirement by the primary users under the constraint that the 
primary encoder (not the decoder) is kept unchanged. By modeling the primary encoder as a generalized 
trellis code (GTC), we are then able to treat the secondary link as a finite state channel (FSC). The 
relation of the accessible capacity to the capacity region of the GIFC is revealed. Upper and lower 
bounds on the accessible capacity are derived. For some special cases, these bounds can be computed 
numerically by using the BCJR algorithm. The numerical results show us, as expected, that primary 
users with lower transmission rates may allow higher accessible rates, and that better primary encoders 
guarantee not only higher quality of the primary link but also higher accessible rates of the secondary 
users. More interestingly, the numerical results show that the accessible capacity does not always increase 
with the transmission power of the secondary transmitter. 
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I. Introduction 

A. Backgrounds 

As an important model for wireless network communications, the Gaussian interference chan- 
nel (GIFC) was first mentioned by Shannon [1] in 1961 and studied a decade later by Ahlswede [2] 
who gave simple but fundamental inner and outer bounds on the capacity region of GIFC. In 
1978, Carleial [3] proved that any GIFC with two pairs of users can be standardized by scaling 
as 

Yi = ^1 + 021X2 + Zi 
Y2 = (112X1 + X2 + Z2 
where the real numbers Xi G Xi, Yi G J^j {i = 1,2) and Zi G M (i = 1,2) are the channel 
inputs, outputs and additive noises, respectively. The channel inputs are required to satisfy power 
constraints Pi and the noises are samples from a white Gaussian process with double-sided power 
spectrum density one. The GIFC is then completely specified by the interference coefficients 
ai2 and 021 as well as the transmission powers Pi and P2. Carleial also showed that, in the 
case that the interference is very strong (i.e., 012 > 1 + P2 and > 1 + Pi), the capacity 
region is a rectangle [3,4]. When the interference is strong (i.e., 0(2 > 1 and a^i > 1), Han and 
Kobayashi [5], and Sato [6] obtained the capacity region by transforming the original problem 
into the problem to find the capacity region of a compound multiple-access channel. The idea 
of this transformation was also employed to find the capacity regions of another class of GIFCs, 
where the channel outputs Yi and Y2 are statistically equivalent [2,3]. The capacity regions of 
a class of deterministic GIFCs were established by El Gamal and Costa [7], where the channel 
outputs are deterministic functions of the inputs satisfying certain conditions. 

However, the determination of the capacity region of the general GIFC is still open. Only 
various of inner and outer bounds are presented. Among these, the best inner bound is that put 
forth by Han and Kobayashi [5], which has been simplified by Chong et al. and Kramer in their 
independent works [8] and [9]. In 2004, Kramer derived two outer bounds on the capacity region 
of the general GIFC [10]. The first bound unifies and improves the outer bounds of Sato [11] 
and Carleial [12]. The second bound follows directly from existing results of Costa [13] and 
Sato [6] and possesses certain properties of optimality for weak interference. 

In light of the difficulty in finding the exact capacity regions of general Gaussian channels, 
Etkin, Tse and Wang [14] introduced the idea of approximation to show that the Han-Kobayashi's 
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Fig. 1. The system model of a Gaussian interference channel. 

inner bound is within one bit of the capacity region. This is a fresh approach towards understand- 
ing multiuser Gaussian channels. However, this result is particularly relevant in the high signal- 
to-noise ratio (SNR) regime. Recently, Bresler, Parekh and Tse [15] extended the approximation 
method to investigate the capacity regions of many-to-one and one-to-many GIFCs and showed 
that the capacity regions can be determined to within constant gaps. They also proposed the use 
of lattice codes for alignment of interfering signals on the signal level instead of in the signal 
space [16][17]. 

B. New Problem Formulation 

In this paper, we present a new problem formulation for the GIFC with two users. For ease 
of comparisons, let us recall the original information theoretic problem of the GIFC. The whole 
system with codes and is shown in Fig. 1. Briefly, the system works as follows. The 
messages at User A are encoded by and transmitted to User B, while the messages at 
User C are encoded by ^2 and transmitted to User D. The messages from User A and C are 
assumed independent and the two senders do not collaborate with each other. User B and D work 
independently to decode the respective received signals for the purpose of correctly extracting 
the respective messages. User B and D are assumed to know exactly the structures of ^1 and ^2- 
The problem of finding the capacity region is equivalent to that of determining whether or not 
a pair of codes {^1,^2) exist with any given respective rates {Ri,R2) such that the decoding 
error probabilities are arbitrarily small. In this original formulation, both ^1 and "^2 are allowed 
to be varied to determine the limits. Typically, on (or near) the boundary of the capacity region, 
they must be a pair of optimal codes. 
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In our new formulation, the two pairs of users are distinguished as primary users and sec- 
ondary users, respectively. The primary users (User A and B) employ a pair of encoder and 
decoder that were originally designed to satisfy a given error performance requirement under 
the assumption that no interference exists from other users. In the case when the secondary 
users (User C and D) attempt to access the same medium, we are interested in the maximum 
transmission rate (defined as accessible capacity) at which secondary users can communicate 
reliably without affecting the error performance requirement by the primary users under the 
constraint that the primary encoder (not the decoder) is kept unchanged. That is, we make an 
assumption that the code '^i of rate -Ri is fixed and only the code ^2 is allowed to be varied 
for the purpose of maximizing the coding rate R2. This assumption is reasonable at least in the 
following two scenarios. 

• It is not convenient (or economic) to change the encoder ^1 at User A for dealing with the 
interference from the secondary users. For example. User A is located in a place (say the 
Space Station) that can not be reached easily. 

• User A is weak in the sense that it can only afford the simple encoders such as ^1 due 
to the limits of its processing ability. For example. User A is an energy-limited wireless 
sensor that collects and transmits data to the powerful data center (User B). 

The main results as well as the structure of this paper are summarized as follows. 

1) In Sec. II, the accessible capacity is explicitly defined by modeling the primary encoder 
as a generalized trellis code (GTC) and using the concept of limit superior in probability 
introduced in [18]. 

2) In Sec. Ill, upper and lower bounds on the accessible capacity are derived by treating the 
secondary link as a finite state channel (FSC) [19]. The relation of the accessible capacity 
to the capacity region is also revealed in this section. 

3) In Sec. IV-A, we show that the derived bounds on the accessible capacity can be evaluated 
numerically using the BCJR algorithm [20] for special cases. 

4) Numerical results are given in Sec. IV-B. We consider only the cases when simple codes 
are implemented at User A and the BPSK signaling is adopted by both senders. The 
reason for choosing simple codes is to make the computation feasible, while the reason 
for choosing BPSK is to get insights into the capacity region in the low SNR regime, where 
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the approximation method [14] becomes helpless. Despite the simple settings, we still have 
the following either expected or interesting observations from the numerical results. 

• Primary users with lower transmission rates may allow higher accessible rates. 

• Better primary encoders guarantee not only higher quality of the primary links but 
also higher accessible rates of the secondary users; 

• The accessible capacity does not always increase with the transmission power of the 
secondary transmitter. 

In this paper, a random variable is denoted by an upper-case letter, say X, while its realization 
and sample space are denoted by x and X, respectively. A sequence of random variables 
(Xi,X2, ■ ■ ■ ,Xn) is denoted by X. The probability mass function (pmf) of a discrete random 
variable X is denoted by pxix), while the probability density function (pdf) of a continuous 
random variable Y is denoted by fviy)- The transition probability mass (density) function from 
X to y is denoted by PY\xiy\x) (fY\xiy\x)). To avoid cluttering the notation in some contexts, 
we may use, for example, pi{xi) in place of Pxii^i) and fi\2iyi\x2) in place of fYi\X2iyi\^2)- 
When no confusion can arise, we even suppress the subscripts at all. 

IL Basic Definitions and Problem Statements 

A. Interference-Free AWGN Channels 

Referring to Fig. 1, we assume that only primary users. User A and B, exist at the beginning. 
That is. User A is sending messages to User B through a discrete-time AWGN channel without 
any interference from other users. The messages from User A are usually represented by integers 
and required to be coded and modulated as a sequence of real signals. This process can be 
described in a unified way by introducing the concept of generalized trellis code (GTC) as 
follows. 

• The code can be represented by a time-invariant trellis and (hence) is uniquely specified 
by a trellis section. 

• A trellis section is composed of left states and right states which are connected by branches 
in between. Both the left and right states are selected from the same set 5 = {0, 1, . . . , |5| — 
1}. 

• Emitting from each state there are M branches. A branch is specified by a four-tuple 

b = (s~(6), n(6), c(6), s+(6)), where s^{b) is the starting state, s+(6) is the ending state. 
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u{b) e {0, 1, . . . , M— 1} is an integer that represents a message to be encoded, and c{b) G M" 
is an n-dimensional real signal to be transmitted over the channel. We assume that a branch 
b is uniquely determined by s~(6) and u{b). We denote the collection of all branches by B. 
• Without loss of generality, we assume that the average energy emitted from each state is 
normalized, i.e., jjJ2b-s'{b)=s ll"^!^)!!^ = where ||c(6)|| represents the squared 

Euclidean norm of c{b). 
To help readers understand the concept of GTC, we give four examples below. 
Example 1 (Uncoded BPSK): The binary phase shift keying (BPSK) modulation can be con- 
sidered as a GTC. The trellis section is composed of one left state and one right state which are 
connected by two parallel branches. The two branches encode messages and 1 to —1 and +1, 
respectively. The trellis section and the branch set B are shown in Fig. 2 (a). □ 
Example 2 (Repetition Coded BPSK (RCBPSK)): The simplest repetition code [2, 1, 2] of rate 
1/2 with the BPSK signaling can be regarded as a GTC. The trellis section is composed of one 
left state and one right state which are connected by two parallel branches. The two branches 
encode messages and 1 to (—1,-1) and (+1,+1), respectively. Fig. 2 (b) gives the trellis 
representation of this generalized trellis code. □ 
Example 3 (Extended Hamming Coded BPSK (EHCBPSK)): Consider the [8,4,4] extended 
Hamming code defined by the parity-check matrix 

/ 1 1 1 1 \ 
10 1110 
10 1110 

\ 1 1 1 1 1 1 1 1 y 

The extended Hamming code with the BPSK signaling can be regarded as a GTC. The trellis 
section is composed of one left state and one right state which are connected by sixteen parallel 
branches, each of which encodes an integer (of four binary digits) to an 8-dimensional real 
signal. Fig. 2 (c) depicts the trellis representation of this generalized trellis code. □ 
Example 4 (Convolutional Coded BPSK (CCBPSK)): Consider the (2, 1, 2) convolutional code 
defined by the generator matrix 

G{D) = [1 + D'^ 1 + D + D% (3) 



H 



(2) 
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Fig. 2. Generalized trellis codes, (a) Uncoded BPSK. (b) Repetition coded BPSK. (c) Extended Hamming coded BPSK. 
(d) Convolutional coded BPSK. 
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The convolutional code with the BPSK signaling can be regarded as a GTC. At each stage of 
the trellis, there are four states {0, 1, 2, 3}, and from each state there are two branches, each of 
which encodes a binary digit to a two-dimensional real signal. The trellis section and the branch 



The system model for the primary link with a GTC is described as follows. 

Encoding: Let wi = (mi,M2, • • • iUn) G Mi be a data sequence, drawn from an independent 
and uniformly distributed (i.u.d.) source, to be transmitted. If necessary, N is allowed to be 
sufficiently large. The encoding is described as follows. 

1) At time t = 0, the state of the encoder is initialized as sq E S. 

2) At time t = 1,2,..., the message ut is input to the encoder and drives the encoder 
from state St-i to St. In the meantime, the encoder delivers a coded signal q such that 

{st-i,Ut, Ct, St) forms a valid branch. 



3) Suppose that the available power is Pi. Then the signal xi^t = v^Q at time t is 

transmitted. The transmitted signal sequence is denoted by xi. The collection of all 
coded (transmitted) sequences is denoted by '^i. Notice that '^i may depend on sq. We 
assume that, given sq, all transmitted sequences are distinct. 
AWGN Channel : The channel is assumed to be an AWGN channel and the received signal 
sequence is denoted by yi, which is statistically determined by 



where zi is a sequence of samples from a white Gaussian noise of variance one per dimension. 

Decoding: Upon on receiving yi. User B can utilize, in principle, the Viterbi algorithm [21], 
the BCJR algorithm [20] or other trellis decoding algorithms [22] to estimate the transmitted 
messages. Assume that a decoder 'ipi is utilized and wi = (ui,U2, . . . ,un) is the estimated 
message sequence after decoding. 

Error Performance Criterion: For all t > 1, define error random variables as 



Depending on the structure of the GTC as well as the assumed decoding algorithm ipi, the 
statistical dependence among the random variables {Et} may be very complicated. In order 



set B are shown in Fig. 2 (d). 



□ 




yi = xi + zi 



(4) 




(5) 
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to characterize the performance of the (de)coding scheme in a unified way, we introduce the 
following random variables 



e^ = ^^, for iV = l,2,... (6) 

and consider the limit superior in probability [18] of the sequence {Oat}- 

Definition 1: Let e be a real number in the interval (0, 1). A generalized trellis code is said to 
be e- satisfactory under the decoder if the limit superior in probability of {Qn} is not greater 
than e, that is, 

p- limsup Gat = inf I a I lim Pr{6Ar > a} = o| < e. (7) 



Equivalently, 



lim Pr{0Ar > e} = 0. (8) 



□ 

In this paper, the given real number e is referred to as the error performance requirement by 
the primary users. 

Remark. From Examples 2 and 3, we can see that a conventional block code of size M 
can be regarded as a generalized trellis code. The trellis section has only one state and M 
parallel branches, which correspond to M codewords, respectively. Such a representation is 
different from those conventional trellis representations in [20,23,24]. For this special class of 
generalized trellis codes, the sequence of error random variables {Et} under commonly-used 
decoders are independent and identically distributed. Then, by the weak law of large number, 
we know that the sequence {Qn} converges to the expectation of Ei in probability. That is, for 
any 5 > 0, 

lim Pr{|eiv-£i| <6} = l (9) 

where = Pr(_Ei = 1). Therefore, the definition that a block code is said to be e-satisfactory 
under a commonly-used decoder is equivalent to that < e, which is consistent with the 
conventional criterion. 

B. Gaussian Interference Channels 

Referring to Fig. 1 again, we assume that User C attempts to send messages to User D by 
accessing the same medium as used by the primary users. In this scenario, cross-talks (inter- 
ferences) may occur. Assume that it is not convenient to change the encoder at User A. Now 
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an interesting question arise: What is the maximum (reliable) transmission rate from User C 
to User D under the constraint that the encoder at User A remains unchanged but the error 
performance requirement is still fulfilled? The detailed formulation of this problem is presented 
in the following. 
Encoding: 

1) The encoding function at User A is 

01 : Ml 

(10) 

where Wi = (ui, U2, ■ ■ ■ ,un) € Aii is an M-ary sequence drawn from an i.u.d. source and 
xi is the coded sequence of length nN such that (wi,xi) corresponds to a path through 
the trellis of the GTC ^1 used by User A. 

2) The encoding function at User C is 

(11) 

W2 X2 = 02(^2) 

where W2 is an integer uniformly distributed over Ai2 = {1,2, ■■ ■ , M2} and X2 is the 
coded sequence of length nN. 

3) The coding rates (bits/dimension) at User A and C are i?i = ^ and R2 = ^-^^ , 
respectively. The coded sequences are required to satisfy the power constraints E [||Xi|p] < 
nNPi and E [||X2f ] < nNP2, respectively. 

Gaussian Interference Channels: Assume that User A and C transmit synchronously xi and 
X2, respectively. The received sequences at User B and D are yi and y2, respectively. For the 
standard Gaussian interference channel as shown in Fig. 1, we have 

yi = xi + 021X2 + zi 

y2 = ai2Xi + X2 + Z2 

where zi and Z2 are two sequences of samples drawn from an AWGN of variance one per 
dimension, and a = (012,021) is the real interference coefficient vector. 
Decoding: 

1) The decoding function at User B is 

^ : M"^ ^ Ml 

A ~ ' (13) 

yi ^ wi = {ui,U2, . . . ,un) = i^iiji) 
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which can be different from the decoder ipi used in the case when no interference exists. 
2) The decoding function at User D is 



: M"^ M 



(14) 

ys t-> W2 = ^2(y2) 

Error Performance Criteria: 

1) For primary users, we define random variables 

f iiUt = Ut 
Et= { for t > 1. (15) 

[ 1 litj^^Ut 

The performance of the link between User A and B is measured by p- lim sup;v-s>oo ©tV' 
where 

9^ = ^^, foriV=l,2,.... (16) 

2) For secondary users, we define ei^^ = Pr{W^2 ^ W2}. 

We make an assumption that User C knows exactly the coding function (pi and attempts to 
find the optimal coding function 02 under certain constraints. We also assume that User B and D 
know exactly the coding functions and attempt to find optimal decoding functions under certain 
criteria. 

Definition 2: A rate R2 is achievable for the secondary users, if for any 6 > 0, there 
exists a sequence of coding/decoding functions (02, V^2) of coding rates > R2 — 6 such that 
lim7v^oo4^^ = 0. □ 

Definition 3: A rate R2 is accessible if R2 is achievable for the secondary users and there 
exists a decoder ipi such that the GTC is e-satisfactory, that is, p- limsup^y^oo ©tv ^ ^ 

Definition 4: The accessible capacity for the secondary users is defined as 



C2 = sup{-R2 : R2 is accessible}. (17) 

□ 

Problem formulation: The problem is formulated as 

given '^x and e, find C2. 
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C. Relation of the Accessible Capacity to the Capacity Region 

As we have mentioned in Introduction, the problem of finding the capacity region^ is equivalent 
to that of determining whether or not a pair of codes (^i, ^2) with any given respective coding 
rates (i?i,i?2) such that the decoding error probabilities are arbitrarily small. To determine the 
capacity region, both ^1 and ^2 are allowed to be varied for the purpose of optimization. In 
our formulation, the primary encoder ^1 is assumed to be fixed and only the secondary encoder 
^2 is allowed to be varied for the purpose of finding the accessible capacity C2. However, the 
accessible capacity is closely related to the capacity region as illustrated in the following, where 
we use the notation C2 = 6*2(^1,6) to indicate that C2 depends on the GTC and the error 
performance requirement e by the primary users. 

• For large e, the pair C2) niay fall outside the capacity region of the GIFC. 

• When e — 7- 0, the pair C2) must fall inside the capacity region. 

• Specifically, the pair (i?i,C|) must lie on the boundary of the capacity region, where C2 
is defined as 

C* = lim sup {C2C^i,e)}. (18) 

III. Bounds on the Accessible Capacity 

In this section, we derive bounds on the accessible capacity of the secondary users. For doing 
so, we rewrite the considered system in (12) in terms of random variables as 

Yi = Xi + 021X2 + Zi 

(19) 

Y2 = 012X1 + X2 + Z2 

where 

• Xi is a random sequence of length nN whose probability mass function pi(xi) can be 
determined by the i.u.d. input to the encoder as well as the initial state of the encoder, in 
other words, Xi is uniformly distributed over ^1 for a given intial state; 

• Zi and Z2 are two sequences of i.i.d. Gaussian random variables of variance one; 

• X2 is a random sequence of length nN whose distribution is to be determined. 



'The explicit definition of the capacity region may be found in the references, say [3]. 
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In this paper, for technical reasons and without loss of generality, we assume that X2 is a 
sequence of discrete random variables, whose pmf is denoted by ^2(^2) for X2 G X^, where 
X2 C M" is a finite set. 

Lemma 1: Both the links X2 — ?■ Y2 and X2 — t- Yi can be viewed as finite state channels 
where the processes of channel states are Markovian. □ 
Proof: From Y2 = 012X1 + X2 + Z2, we can see that the transition probability from X2 to 
y2 depends on the random sequence xi, which corresponds to a path through the trellis of the 
GTC ^1. To prove that this channel is a finite state channel as defined in [19], we need to define 
a channel state such that, conditioned on the channel state and the current input, the channel 
output is statistically independent of all previous inputs and outputs. Let st E S he the trellis 
state at the t-th stage of the GTC. We can see that the channel X2 — t- Y2 is then completely 
characterized by 

1 1 \\y2 1 ~ CiU^l t — X2 tW^ ^ 

f{y2,ust\x2,t,st^,) = ^— ^^-^exp{ ■ ^ ^—}, (20) 

where Xi,t = y/Pic{b) and the summation is over all branches b connecting Sj„i and St- This 
allows us to follow Gallager [19] and to work with the conditional probability /(y2, SAr|x2, sq), 
which can be calculated inductively from 

/(y2, SAr|x2, So) = ^ f{y2,N, Sn\x2,N, S N-i) f {yi'^~^\ S N~l\^i^~^\ Sq) , (21) 
sn-1 

where x^^"^^ = (x2,i, ^2,2, ■ ■ ■ , X2,n^i) and y^^"^^ = (2/2,1, ^2,2, ■ ■ ■ , y2,N~i)- The final state can 
be summed over to give 



/(y2|x2, So) = ^ /(y2, SAr|x2, So). (22) 



sn 



The channel state process {St} is a Markov process, which evolves freely (independently from 
the input X2) with the following transition probabilities 

number of branches connecting St-i and St 
PSt\St-ASt\st~i) = (23) 

for Sf-i E S,St E S. Therefore the link X2 — t- Y2 is a noncontrollable FSC [25-27]. Similarly, 
the link X2 — t- Yi is also a noncontrollable FSC with the channel state process {St}- ■ 
Following Gallager [19], define 

Cu^ = \r max max/(X2;Y2|so) (24) 

^ nN {P2{x2)} SQ 
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and 

= \ max minmin{/(X2; Yi|so),/(X2; Y2IS0)}, (25) 
nM {P2(x2)} so 

where the set {p2(x2)} consists of all possible pmfs P2(x2) over X2 such that E[||X2||^] < 
nNP2. 

Lemma 2: The limits Cr = lim cl^^ and Cn = lim ci^^ exist. □ 
Proof: The existence of Cu can be proved by applying directly Theorem 4.6.1 in [19]. To 
prove the existence of Cl, we define a new FSC whose channel states are drawn from S = 
{1, 2} X S. Given an initial state sq = (h sq), the new FSC channel is completely characterized 
by 

/Y|X2(y|X2,So) = < . (26) 

[ /Y2|X2(y|x2,So), if 1 = 2 

Then the definition of C^j^'' in (25) can be rewritten as 

Cr^^T max min/(X2;Y|.-o) 

^ niV{p2(x2)} So ^ ' ^ 

and the existence of Cl becomes obvious from Theorem 4.6.1 in [19]. ■ 
The main result of this section is stated in the following theorem. 
Theorem 1: The accessible capacity C2 is bounded as 

Cl<C2< Cu. (27) 

□ 

Proof: Firstly, we prove that any rate R2 > Cu is not achievable for the link X2 — t- Y2. 
It is equivalent to prove that, for any code, if the probability of decoding error e^'^ — as 
— J- 00, then the coding rate R2 < Cu- 

Actually, from Fano's inequality and data processing inequality [28], we have 

nNR2 = HiW2\so) = iy(1^2|Y2, Sq) + /(1^2; Yajso) 

< l+£fWi?2 + /(W^2;Y2|So) 

< l + £fWi?2 + /(X2;Y2|so). (28) 



Dividing by nN, 



R2 < 4?+4'^^^2 + 4?^(X2;Y2|so) (29) 
< ^+4"^i?2 + Cr. (30) 



(31) 



SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY, DECEMBER, 2010 15 

As — )• oo, we have R2 < Cu since — ^ and e^^'^ — > 0. 
Secondly, we prove that any rate R2 < Cl is accessible. 

Applying Theorem 5.9.2 in [19] to the newly defined FSC in (26), we have the following 
facts. 

For any e > 0, there exists N{e) such that for each A^ > N{e) and each -R2 > there exists 
a block code ^2 with rate R2 and codeword length nN such that, for all initial states sq G S, 

-2 

where 

• e^^^ is the average probability of erroneously-decoding W2 from the received sequence Yi 
at User B by the maximum-likelihood decoding algorithm 1; 

• £2^^ is the average probability of erroneously-decoding W2 from the received sequence Y2 
at User D by the maximum-likelihood decoding algorithm ?/'2; 

• Er{R2) is the random coding error exponent, which is strictly positive for R2 < Cl. 
Therefore, as A^ — t- 00, e"^^ — > and £3^^ — t- 0. The latter implies that the rate R2 is achievable 
for the secondary link X2 Y2. 

To complete the proof, we need to find a decoder such that the error performance require- 
ment e is still fulfilled, that is, Pr(97v < e) — ?■ 1- Such decoders do exist, one of which is the 
following two- stage decoder. 

Step 1: Upon receiving yi. User B utilizes the maximum-likelihood decoder ipi^i to get an 
estimated message W2- The probability of decoding error e^^^ = Pr{W^2 7^ W2} goes 
to zero as A^ goes to infinity. For convenience, we introduce a random variable as 

f 0, W2 = W2 
Ti=<^ ' . . (32) 

[ 1, 1^2 ^1^2 

Then ej^^ = Pr(Ti = 1). 
Step 2: User B re-encodes W2 to get an estimated coded sequence X2 = <p2{w2)- Then User B 

uses the primary decoder ipi to decode the sequence yi = yi — 021^2 to get a sequence 

of estimated messages wi = {ui,U2, . . . ,un)- 
For this two-stage decoder, the statistical dependence among the error random variables {Et} 
as defined in (15) becomes even more complicated. On one hand, the erroneously-decoding W2 
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at User B may cause burst errors in wi at the second stage. On the other hand, the correctly- 
decoding W2 at User B indicates that the link X2 — ?■ Yi is not that noisy, equivalently, that the 
sum of the transmitted codeword xi and the Gaussian noise sequence zi is not that "strong". This 
implies that^, even in the case of Ti = 0, the random variables {Et} may still have a different 
distribution from the random variables {Et} as defined in (5). Fortunately, this complicatedness 
does not affect the correctness of p- limsup^y^^oo ©tv < Actually, 

Pr{e^>e} = Pr{ejv>e,Ti = 0} + Pr{e7v>e,Ti = l} 

< Pr{eAr >e,Ti = 0} + 4'^^ 

< PT{QM>e} + e[^^ (33) 
0, as iV ^ cx). (34) 

■ 

An immediate consequence of Theorem 1 is the following corollary, which is related to a 
similar case when interferences are strong. 

Corollary 1: If /(X2; Y2IS0) < /(X2; Yi|so) holds for all pmfs P2(x2) and sq e S, then 
C2 = Cl = Cu. □ 

As a special class of GTCs, block codes satisfy that all components xi^t in the coded sequence 
xi = (xi^i, xi,2, • • • , xi^n) are independent. In this case, both the links X2 Yi and X2 — > Y2 
can be viewed as block-wise memoryless channels. In this case, we have 

Corollary 2: For conventional block codes (GTCs with only one state), the bounds on the 
accessible capacity are reduced to 

Cu = - max /(X2;F2), (35) 

n{v2{x2)} 

and 

Cl = - max min{/(X2; n), J(X2; F2)}, (36) 

n {P2{x2)} 

where the set {^2(2^2)} consists of all possible pmfs over X2 such that E [||X2p] < nP2. □ 
Similar to Corollary 1, we have the following corollary whose condition is slightly weaker. 

^This also implies that Pr{ejv > e, Ti = 0} < Pr{ejv > e}. 
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Corollary 3: For conventional block codes (GTCs with only one state), if /(X2; Y2) < I{X2] Yi 
holds for the pmf = arg max /(X2; Y2), then C2 = C'l = Cu- That is, 

{P2{X2)} 



C2= -/(X2;F2) 

n 



(37) 



□ 

Remark. As seen from (24) and (25), the initial state of the GTC is involved in the derived 
bounds. This cannot be avoided if the initial state is not known to the secondary users or if 
the access time^ of the secondary users is at a random time t instead of t = 0. However, most 
GTCs (for example, block codes and convolutional codes) satisfy that the process {St} takes 
the uniform distribution as the unique stationary distribution. Equivalently, a sufficiently long 
i.u.d. sequence of inputs at User A can drive the GTC encoder from any given initial state into 
each state with equal probability. In this case, both the links X2 —J- Y2 and X2 — ?■ Yi are 
indecomposable [19]. Then the initial state can be fixed in the derived bounds. 



IV. The Evaluation of the Upper and Lower Bounds 

We have now derived upper and lower bounds on the accessible capacity of the considered 
GIFC as shown in (27). However, it could be very complicated to evaluate these bounds. The 
difficulty arises from the following two facts. Firstly, a complex GTC for primary users that has 
a large number of branches must result in intractable FSCs for the secondary links. Secondly, 
even if the GTC is simple, the space of sequences X2 expands exponentially as the length N 
increases, which makes it infeasible to optimize the mutual information rates over all possible 
pmfs P2(x2) for large A^. Therefore, we consider only those tractable GTCs and assume that the 
transmitted signal sequences X2 G X2 are independent and uniformly distributed (i.u.d.) under 
the power constraint P2. Under this assumption, the evaluated "upper" bounds are actually the 
lower bounds of the upper bounds. 

In what follows, we have fixed the initial state as Sq = and removed it from the equations 
for simplicity. 



^By a time we mean a stage of the trellis that represents the GTC. 
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A. Computations of the Mutual Information Rates 
Similar to [29-32], we can use a method to compute 



Cj;-"-'-) = lim -\^I{X2;Y,) (38) 



and 



Ct-'-^ = lim 4? min{/(X2; Yi), /(X^; Y^)}, (39) 



where P2{^2) = p^pv- As we have pointed out, (7^ " '^ ) a lower bound of the derived upper 
bound Cu and hence it may not be an upper bound on the accessible capacity C2. However, 
does serve as a lower bound on C2. 
We focus on the evaluation of the "upper" bound, while the lower bound can be estimated 
similarly. Specifically, we can express the rate " ) as 



C^-'-^ = Um -i^/(X2;Y2) 



1 

N->-oo nN 

lim —h(Y2) - lim — /ifYalXa) 



= lim lim 4-/i(ai2Xi + Z2). (40) 

These two entropy rates ^im ^/i(Y2) and ^im ^/i(ai2Xi + Z2) can be computed by the 
same method since both Y2 and 012X1 + Z2 can be viewed as hidden Markov chains. As an 
example, we show how to compute ^im j^h{Y2) in the following. 

From the Shannon-McMillan-Breiman theorem [28, Theorem 15.7.1], we know that, with 
probability 1, 

lim -^log/(y2) = lim -\mY2), (41) 

TV-s-oo nJM Af-s>oo ni\ 



since the sequence Y2 is a stationary stochastic process. Then evaluating lim ^/i(Y2) is 
converted to computing 



lim 



-;^log/(y2) - -^log [\{f{y2Ayt'') = -;j^j:^ogf{y2Ayt'') (42) 

\t=i / t=i 



for a sufficiently long typical sequence y2. Then, the key is to compute the conditional prob- 
abilities f{y2,t\y2^^^) foi" ^- This can be done by performing the BCJR algorithm over a 
new (time-invariant) trellis, which is constructed by modifying the original trellis of the GTC 
^i. Actually, the link X2 — ?■ Y2 can be represented by the following modified trellis. 
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Fig. 3. A trellis section of the link X2 — Y2 where the GTC represents the (2,1,2) convolutional coded BPSK shown in 
Example 4. 



• The new trellis has the same state set 5 = {0, 1, . . . , |5| — 1} as the GTC ^i. 

• Each branch b = {s~ (b) , u{b) , c{b) , (b)) in B of the original trellis is expanded into \X2\ 
parallel branches 

\b=(s~{b),u{b),c{b),X2{b),s'^{b))\ X2{b)EX2 is the transimitted signal at User C} . 

(43) 

Fig. 3 depicts a trellis section of the link X2 Y2, where the GTC is the (2,1,2) 

convolutional coded BPSK as introduced in Example 4. 

Given the received sequence y2 at User D, similar to the BCJR algorithm [20], we define 
Branch metrics: To each branch bt = {st-iiUt, Ct, X2,t-i St), we assign a metric 

p{bt) = f{bt,y2^t\st~i) 

= piUt) Pix2,t) f\y2,t\Ut, X2^t) 

111 / ||z/2,t-ai2/PiQ-a;2,tin .... 

exp < ■ — > . (44) 



M\X2\{2nf^ 

State transition probabilities: The transition probability from st-i to st is defined as 

7t(st_i,st) = f {st,y2,t\st-i) (45) 

b:s- (b)=st-i,s+ (b)=st 
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Forward recursion variables: We define the posterior probabilities 

at{st)=p{st\y?), t = 0,l,...,iV. (47) 

Then 

f{y2,t\y2'^^)= ^ at^i{st^i)-ft{st^ust), (48) 

St-l,St 

where the values of at{st) can be computed recursively by 

Mst) = ^ J T- (49) 

In summary, the algorithm to estimate the entropy rate ^im ^h{Y2) is described as follows. 
Algorithm 1: 

1) Initializations: Choose a sufficiently large number A^. Set the initial state of the GTC 
to be So = 0. The forward recursion variables are initialized as ao{s) = 1 if s = and 
otherwise ao{s) = 0. 

2) Simulations for User A: 

a) Generate a message sequence {ui,U2, . . . ,uj^) independently according to the uni- 
form distribution p{U = Ui) = jj. 

b) Encode the message sequence by the encoder of the GTC and get the coded 
sequence (ci, C2, . . . , cat). 

c) Transmit the signal sequence xi = ^/P[{cl, C2, . . . , cat). 

3) Simulations for User C: 

a) Generate a sequence X2 G (A'2)^ independently according to the uniform distribution 

V{.X2) = p^. 

b) Transmit the signal sequence X2. 

4) Simulations for User D: 

a) Generate an (nA^)- sequence Z2 G M"^ independently according to the Gaussian 
distribution A/'(0, 1). 

b) Receive the sequence y2 = 012X1 + X2 + Z2. 

5) Computations: 

a) For t = 1, . . . , N, compute the values of f{y2,t\y2~^^) ^i^d at{st) recursively accord- 
ing to equations (48) and (49). 
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TABLE I 
Comparison of the GTCs 



Code 


Rate 


Pi 


BER 


Uncoded-BPSK 


1 


6 


« 0.72 e-2 


[2, 1,2]-RCBPSK 


1/2 


6 


^ 0.28e-3 


[8, 4, 4]-EHCBPSK 


1/2 


6 


^ 0.20e-4 


(2, 1,2)-CCBPSK 


1/2 


6 


^ 0.63e-7 


(3, 1,2)-CCBPSK 


1/3 


6 


< 0.63e-7 



b) Evaluate the entropy rate 

1 1 ^ 



N^oo nN nN 

t=i 



□ 



Similarly, we can evaluate the entropy rate lim ^/i(ai2Xi + Z2). Therefore, we obtain the 



bound as 



^(i.n.d.)^ lim \h{Y2)- lim i^/,(ai2Xi + Z2). (51) 



B. Numerical Results 

In this subsection, we give the numerical results to show the behaviors of the accessible 
capacity. We assume that both User A and C utilize BPSK modulations since we are primarily 
concerned with the low-SNR regime. The GTCs at User A we simulated are listed in Table I, 
where the first four GTCs are the examples introduced in Sec. II-A and the last GTC is the (3, 1, 2) 
convolutional code (defined by the generator matrix G{D) = \\ + D 1+ D'^ \ + D + D"^]) with 
the BPSK signaling. The power at User A is fixed to be Pi = 6, while the power P2 at User C 
is allowed to be varied. The GIFCs we simulated have interference coefficients = '^21 = l-^^ 
'^12 = '^21 = 1' '^12 = '^21 = O-S, or 0^2 = 0.5, 021 = 1.5. 

Figs. 4, 5 and 6 illustrate the computational results for three different GTCs of the same 
coding rate 1/2 over three GIFCs with different interference coefficients, respectively. From the 
three figures, we can see that, at a fixed primary coding rate Ri, a better GTC not only provides 
a better error performance but also allows a higher accessible capacity. 

Figs. 7, 8 and 9 illustrate the computational results for three different GTCs with dijferent 
coding rates over three GIFCs with different interference coefficients, respectively. From these 
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three figures, we can see that primary users with lower coding rates allow higher accessible 
capacities. 

Fig. 10 illustrates the computational results for the asymmetric GIFC with ai2 < 1 and 021 > 1. 
From this figure, we can see that the upper bounds coincide with the lower bounds, which verifies 
Corollaries 1 and 3. 

It is worth pointing out that, as seen from the above figures, the accessible capacity does not 
always increase as P2 increases. This is because that, given the primary encoder, the secondary 
links are no longer AWGN channels. The "noise" seen by User D, which is composed of 
interference from the primary user and the Gaussian noise, may have a probability density 
function of multi-modes. Usually, for an additive noise with single mode, the transmitted signals 
at the secondary user become more distinguishable as the transmission power increases. However, 
when the additive noise has multiple modes, higher transmission power may result in heavier 
overlaps between the likelihood functions. Let us see an example. Suppose that User A utilizes 
uncoded BPSK encoder with fixed power Pi = 6. In the case of 0(2 = 1-5, the noise seen by 
User D is = ai2-^i + Z2, which has a probability density function f{v) of two modes as 
shown in Fig. 11 (a). Suppose that User C employs BPSK signaling {+V^, — V^}- As P2 
increases from to 2, we can see that the two likelihood functions f+{v) = f{v — a/^) and 
f~{v) = f{v + become more and more distinguishable, as shown in Fig. 11 (b). While, 

as P2 continuously increases, the two likelihood functions become less and less distinguishable, 
as shown in Fig. 11 (c). Finally, as P2 goes to infinity, the two likelihood functions are (almost) 
completely distinguishable, as shown in Fig. 1 1 (d). 

V. Conclusion 

In this paper, we have presented a new problem formulation for the GIFC with primary users 
and secondary users. We defined the accessible capacity as the maximum rate at which the 
secondary users can communicate reliably without affecting the error performance requirement 
by the primary users. By modeling the primary encoder as a generalized trellis code (GTC), 
we have derived upper and lower bounds on the accessible capacity. We have also revealed the 
relationships between the accessible capacity and the conventional capacity region of the GIFC. 
For some special cases, these bounds can be computed by the BCJR algorithm. The numerical 
results show us that, either as expected or interestingly. 
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Fig. 9. Bounds on the accessible capacities of the GIFC with ai2 ~ 0-21 ~ 0.5 for different GTCs with different coding rates. 
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Fig. 10. Bounds on the accessible capacities of the asymmetric GIFC with = 0.5, = 1.5 for different GTCs representing 
conventional block codes with the BPSK signaling. 
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Fig. 11. The "noise" seen by the secondary user (User D) is the sum of the interference from User A and the Gaussian noise 
Z2, i.e., V = 012X1 Z2. Let ai2 — 1.5 and Xi be drawn from — uniformly. In sub-figure (a), the two-mode 

curve characterizes the pdf /(t>) of V. Sub-figure (b) shows us that, as P2 increases from to 2, the two likelihood functions 
,f^{v) — f{v + "s/!^) and ,f+{v) = f{v — -^Z!^) become more and more distinguishable. While, sub-figure (c) shows us that, 
as P2 continuously increases, the two likelihood functions become less and less distinguishable. Finally, for sufficiently large 
P2, the two likelihood functions are (almost) completely distinguishable, as shown in sub-figure (d). 
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• at a fixed coding rate Ri, better primary encoders guarantee not only higlier quality of the 
primary links but also higher accessible rates of the secondary users; 

• primary users with lower transmission rates may allow higher accessible rates; 

• the accessible capacity does not always increase with the transmission power of the sec- 
ondary transmitter. 
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